profile

Pipeline To DE

Top data engineering writer on Medium & Senior Data Engineer in media; I use my skills as a former journalist to demystify data science/programming concepts so beginners to professionals can target, land and excel in data-driven roles.

Featured Post

[ETR #16] Better Data Solutions In 5 Steps

Extract. Transform. Read. A newsletter from Pipeline Hi past, present or future data professional! When you apply to data analysis, data engineering or data science jobs, you likely consider factors like company name, culture and compensation. Caught up in the excitement of a fresh opportunity or compelling offer you’re neglecting an important part of your day-to-day reality in a new role: What stage of data maturity the organization is in. If you’re looking for experience building something...

Extract. Transform. Read. A newsletter from Pipeline Sponsored by Basejump AI. Don't just query your data; chat with it. Learn more. Hi past, present or future data professional! If you’re a hybrid or remote worker (or online student) you know the FOMO that sets in when you leave your desk and something at work needs your immediate attention. Even though data engineering is a role that can be done from anywhere, having to open, set up and position a laptop isn’t ideal in all situations like...

Extract. Transform. Read. A newsletter from Pipeline: Your Data Engineering Resource Presented by Basejump AI Use natural language prompts to chat with your database in Basejump’s intuitive interface, or embed it directly in your application. Book your demo here. Hi past, present or future data professional! One thing that makes my work day easier is when I’m Google-ing (as all software developers do) a problem and I come across the holy grail of solutions: A one-line implementation. Like...

The Latest From Pipeline Hi past, present or future data professional! The opening scene of The Social Network, in which a fictionalized Mark Zuckerburg writes enough code to create a website in a single night, has forever skewed new engineers’ perceptions of development pace. If you think about it, media depictions of coding are almost always blisteringly fast and under duress. So, when you start coding in your first job, you might feel like me: Pressured to crank out as much code as quickly...

Extract. Transform. Read. A newsletter from Pipeline: Your Data Engineering Resource Hi past, present or future data professional! Somewhere along your professional development journey someone lied to you. They told you to crank out resumes because no one reads cover letters. This couldn’t be further from the truth as 87% of hiring managers read cover letters. Such a high read rate represents a compelling opportunity to sell your data skills and showcase a bit of personality. The problem?...

The Latest From Pipeline: Your Data Engineering Resource Hi past, present or future data professional! I hope you’ll indulge my sharing of an important career milestone; unfortunately, I’m not retiring with a gold Rolex snug on my wrist. Instead, this week marks 3 years in data engineering. I’m excited about this work-iversary because it marks a period of time in which I’ve been working in data engineering longer than my prior non-data job. If you’ve read my work you know I’ve taken an...

Extract. Transform. Read. A newsletter from Pipeline: Your Data Engineering Resource Hi past, present or future data professional! Browsing through files recently, I found 100+ old resumes I used to apply for data jobs in 2021. While data science is sold as a “good career”, the truth is it’s always been tough to break in. Those looking for jobs need to do more than ever to distinguish themselves. For anyone looking for a job you may have been taught to network with recruiters and hiring...

The Latest From Pipeline: Your Data Engineering Resource Hi past, present or future data professional! One of the worst habits you can adapt in data engineering is to accept a tool or technology as a black box you’ll simply never understand. For me, for the longest time, this was virtual machines. I would commit and troubleshoot code that would run within a VM but never quite knew how to interact with it. Recently, I provisioned a Google Cloud Compute Engine instance for a junior teammate and...

Extract. Transform. Read. A newsletter from Pipeline: Your Data Engineering Resource Hi past, present or future data professional! I bet when you think of data engineering (or software engineering, for that matter) you don’t think about development pace. After all, the buzzworthy anecdotes and lofty promises surround performance of a build, not the speed of its architects. But adaptability and the ability to work very quickly at times is a role expectation you won’t see listed on a job...

The Latest From Pipeline: Your Data Engineering Resource Hi past, present or future data professional! Have you heard about the programmer who successfully automated his job to the point where he did no work for 5 years? Unfortunately, automation efforts are rarely this comprehensive—or successful. In fact, spending time on automation often results in a time sink, requiring more time to conceive and create the automation than time it saves you. In the latest from Pipeline, I provide a simple...